Reproducibility as a service
نویسندگان
چکیده
Recent studies demonstrated that the reproducibility of previously published computational experiments is inadequate. Many these never recorded or preserved their environment, including packages installed in language, libraries on host system, and file locations. Researchers have created tools to help mitigate this problem, but assume experiment currently executes. Thus, do not facilitate large number experiments. This situation improving; researchers continue publish without using tools. We define a framework distinguish between actions taken by researcher presence environment enable reproduction an when has been lost clarify gap what existing are capable required reproduce The difference approaches lies availability environment. provide access original perform proactive reproducibility, while those who only retroactive reproducibility. present Reproducibility as Service (RaaS), which is, best our knowledge, first tool explicitly designed demonstrate how RaaS fixes many common errors found R scripts Harvard's Dataverse preserves recreated Finally, we discuss service such also helpful ‘artifact evaluation assistant’ journal's publication pipeline.
منابع مشابه
Reproducibility as a Technical Specification
Reproducibility of computationally-derived scientific discoveries should be a certainty. As the product of several person-years’ worth of effort, results – whether disseminated through academic journals, conferences or exploited through commercial ventures – should at some level be expected to be repeatable by other researchers. While this stance may appear to be obvious and trivial, a variety ...
متن کاملQoSaaS: Quality of Service as a Service
QoSaaS is a new framework that provides QoS information portals for enterprises running real-time applications. By aggregating measurements from both end clients and application servers, QoSaaS derives the quality information of individual system components and enables system operators to discover and localize quality problems; end-users to be hinted with expected experience; and the applicatio...
متن کاملDeduction as a Service
We describe a system offering deduction (over a fixed but flexible background theory) as a service, provided to a client via a network connection. The deduction server maintains the (potentially) large background knowledge base in a form that makes processing of individual conjectures and queries easy and avoids most of the overhead of reading and analyzing large background theories for each in...
متن کاملRouting as a Service
In Internet routing, there is a fundamental tussle between the end users who want control over the end-to-end paths and the Autonomous Systems (ASes) who want control over the flow of traffic through their infrastructure. To resolve this tussle and offer flexible routing control across multiple routing domains, we argue that customized route computation should be offered as a service by third-p...
متن کاملDystopia as a Service
Keynote Address Dystopia as a Service Adrian Cockcroft, Netflix Summarized by Rik Farrow ([email protected]) Adrian stated that they are engineers trying to solve hard problems and to fix things when they break. We all want perfect code on perfect hardware. But perfection takes too long, utopia is slightly out of reach. So they compromise, focusing on time-tomarket instead of quality. At Netflix, ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Software - Practice and Experience
سال: 2023
ISSN: ['0038-0644', '1097-024X']
DOI: https://doi.org/10.1002/spe.3202